HEAT KERNEL AND RATES OF MIXING FOR COMPACT 
EXTENSIONS OF EXPANDING MAPS 



FREDERIC NAUD 



Abstract. We consider skew-extensions T : I x G of real analytic 
markov expanding maps of the interval T : I — > I by a compact Lie 
group G. We show that for the natural T-invariant measures associated 
to an analytic potential ip, there exists an infinite dimensional cone of 
real valued and analytic observables for which the rate of mixing enjoys 
an explicit exponential lower bound related to the topological pressure 
P(2<p). This estimate is consistent with a conjecture of Dolgopyat and 
Pollicott on the spectrum of complex transfer operators. 



1. Introduction 

Partially hyperbolic systems form a non structurally stable class of dy- 
namical systems whose ergodic and statistical properties are considered dif- 
ficult to study, mainly because of the presence of a neutral bundle which 
prevents application of all classical tools designed for uniformly hyperbolic 
systems. Compact Lie groups extensions of uniformly hyperbolic systems is 
an interesting familly of such maps where issues such as stable ergodicity 
and mixing can be studied in detail with the techniques of Lie groups and 
representation theory. For a detailed account on the history of the qualita- 
tive ergodic theory of such systems, we refer the reader to the introduction 
of [9] and references herein. In this paper we will focus on partially hyper- 
bolic maps obtained as skew extensions of expanding maps of the interval. 
Let T : I 7 be Q a Markov, topologically mixing, smooth enough, uni- 
formly expanding map of the unit interval 7 = [0, 1]. Let G be a compact 
connected Lie group endowed with the normalized Haar measure m, and 
consider r : I — )■ G a smooth map. The skew extension T : I x G — > I x G 
of T is defined by 

T(x,g) = (Tx,r(x)g). 

Let be the unique equilibrium T-invariant measure related to a Holder 
potential (p on 7, then the product measure /x^ := /i^ x m is a T-invariant 
measure. A popular choice of ip would be ip = — log|T'| which yields the 
absolutly continuous SRB measure. Let F, G be some reasonably smooth 
functions on 7 x G, then a fundamental question of ergodic theory is to 
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investigate the asymptotic behaviour of the correlation function defined for 
n € N by 

C v (F,G)(n) := [ {FoT n )Gd^-[ Fdfcp I Gd^. 

JlxG JlxG JlxG 

Correlation functions are the basic objects that give a measure of the "chaotic- 
ity" of the system and are not only interesting for themselves but also be- 
cause of their relationship with fine statistical properties such as the central 
limit theorem. One of the very first quantitative result is the exponential de- 
cay for equivariant observables that can be found in Field-Melbourne-Torok 
|14| . At the same time, Dolgopyat showed in the case of the SRB measure [U] 
that for generic r and Holder observables F, G, the correlation function de- 
cays exponentially fast as n — > +00. Moreover, this property is equivalent to 
stable ergodicity (within the set of skew extensions). The exponential bound 
obtained through Dolgopyat technique is however hardly explicit and does 
not tell us how the different parameters (lyapunov exponents, topological 
entropy) of the system influence this rate of mixing. On the other hand, still 
in the case of the SRB measure, it is very likely that the more recent ma- 
chinery of Tsujii et al, [HUT] should provide an explicit upper bound related 
to the maximal expansion rate of the map T. In [9], Dolgopyat raises the 
question of finding examples where effective estimates on correlations can 
be proved. In the case of non uniformly hyperbolic systems, lower bounds 
on the rate of mixing are notoriously hard to prove, and there exists to our 
knowledge no general results in that direction for exponentially mixing sys- 
tems. Motivated by the lower bounds we obtained in [T7] for real analytic 
semi-flows which are toy models of Anosov flows, we show in this paper that 
for general real analytic compact extensions T, it is possible to build an infi- 
nite dimensional manifold of real analytic observables for which correlations 
functions enjoy an effective lower bound related to the topological pressure 
of Tup. 

There is therefore, like in the case of semi-flows [17] . a natural barrier 
to the speed of mixing which is related to entropy. We point out that this 
behaviour contrasts sharply with the case of uniformly hyperbolic systems 
where the rate of mixing for analytic observables can be superexponential, 
for example in the case of linear hyperbolic maps on the torus. 

Let us give some more precise statements. First we will work with extensions 
by a compact connected Lie group G, which is non-trivial i.e. G 7^ {Id}. 
The skew function r : [0,1] — > G is assumed to be real analytic 0. About 
the expanding map T : I — > I, we will assume that 

I = [0, 1] = Uj =1 /i, k > 2, 

where each 2j = [a», bj\ is a closed interval and Int(Ij) D Int(Jj) = if i ^ j. 
For all i = 1, . . . , k, the map Tj := T|[ a . b .] is real analytic, and is a one-to 
one and onto map Tj : f — > [0, 1] which is uniformly expanding i.e. 

min|2^(x)| > 1. 

x£li 



'We will give a precise meaning to this in the next 
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Under these standard assumptions, T : [0, 1 — > [0, 1] is topologically mixing 
and is semi conjugated to the full shift 

a:{l,...,fc} N ->{l,. ..,*}» 

on k symbols^!. We will be concerned with T-Invariant equilibrium measures 
Htp where the potential ip : I — ¥ R is also real analytic on [0, 1]. The asso- 
ciated measure is then the unique measure maximizing the topological 
pressure (variational formula) : 

P(ip) = sup <^ hfj,(T) + / cpd/j, \ , 

(J.£M inv I JO J 

where "Mi nv is the set of T-invariant probability measures and h^{T) is the 
measure theoretic entropy. For simplicity, we will assume that P((p) = 
which is the case for all popular potentials. 

Under the above assumptions and notations, we prove the following result. 

Theorem 1.1. There exists a constant 7(G) > such that for all e > 0, 
one can find an infinite dimensional cone Q e of real valued, analytic functions 
such that for all F G Q e , 

limsup|C7 v (F,F)(n)|» > e^ p ^- e . 

n— >+oo 

Remarks. We always have the lower bound 

P(2<p) > J <pdn v = -V( T ) ^ -^top(T) =-log(fc), 

with equality if and only if (p is cohomologous to — log(/c) the potential of the 
measure of maximal entropy. On the other hand in the case of the smooth 
invariant SRB measure (</? = — log \T'\), it tells us that if the derivative of 
T at a fixed point xq is of size 1 + e, then 

P(2ip) > h Sxo (T) - 2 Jhg\T'\d5 X0 = -21og(l + e), 

where 5 XQ is the dirac mass at xq. Thus P(— 2 log | T" | ) tends to as e — > 
0, hence exhibiting arbitrarily slow rates of (exponential mixing) for the 
extension T. In the case of the measure of maximal entropy, our lower 
bound remains unaffected by the expanding properties of T. This is not 
surprising in view of the recent result of Goiiezel |15| who was able to obtain 
exponential rates of mixing (for the measure of maximal entropy) in the case 
of skew-extensions of intermittent markov maps with neutral fixed points. 

Although the statements above bear some obvious similarities with the re- 
sults we obtained for semi-flows, the proof requires some new ideas to deal 
with the compact factor G in full generality. In particular, we need to prove 
some a priori bounds on the growth of certain dynamical zeta functions 
that do not follow from [IT]. The key a priori estimates are derived from 

In addition, the intersection of two different intervals Ii and Ij, if not empty, cannot 
contain periodic points of T (only pre-periodic points). Therefore there is a one-to-one 
correspondence between periodic points of the shift map a and periodic points of T. 

4 The constant 7(G) depends essentially on the rank of G that is the dimension of 
maximal torii, an explicit expression will be provided in §7. 
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Sogge's bound [23] and Donnelly- Fefferman work [IT], which are both sharp 
results on elliptic partial differential operators on compact manifolds. The 
core of the argument in [17] is a Selberg's like trace formula for semi-flows. 
In the present setting, we need to deal with a discrete family of transfer 
operator indexed by irreducible representations and we have to replace the 
trace formula argument by a more delicate analysis based on the heat kernel 
and volume estimates around maximal Tori. We believe, based on some 
heuristics on transfer operators [10] (see §2) that the term P(2<p) is opti- 
mal, whereas the constant 7(G) may not be. We also point out that we 
have chosen in this paper to keep the hyperbolic factor as simple as possi- 
ble, concentrating on the compact group factor G. It is however clear from 
our technique that similar results can be obtained without major modifi- 
cations for extensions of real analytic expanding map of the torus or real 
analytic Anosov diffeomorphisms by using the approach of Faure-Roy [13 
for example. 

The plan of the paper is as follows. In § 2 we prove the main result by 
reduction to a spectral result on a family of transfer operators twisted by 
the irreducible representations of the group G. In §3, we give the proof in 
the simplest case of the one dimensional torus which is a good outline of the 
general case, without the difficulties of the abstract general setting. Section 
§4, §5 are devoted to some a priori bounds on certain Fredholm determinants. 
These bounds are not obvious in general and require some elliptic partial 
differential equation arguments. In §6 we recall some basic facts on the heat 
kernel on G, our main tool. Finally, we gather our results and prove the key 
theorem in §7 following the line of proof of the torus case. 

2. Representations and twisted transfer operators 

In this section, we show how to reduce Theorem II .11 to a spectral result on 
a family of transfer operators. We use the notations of the introduction. Let 
ip : / — > R be an analytic potential with zero topological pressure P((p) = 0. 
The (positive) Ruelle transfer operator is defined as usual on continuous 
functions by 



The Classical Ruelle- Perron- Frobenius Theorem, see for example [21 I18j . 
states that there exists a unique probablity measure v v such that for all 



In addition there exists an invariant positive continuous non-vanishing den- 
sity h v £ C°(I) such that 



Ty=x 



f 6 C°(I) 





The equilibrium T-invariant probability measure [i^ that realizes the pres- 
sure is, up to normalization, n v = h v v v . 
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Let 7r : G — > GL(V) be a finite dimensional irreducible complex represen- 
tation of G, that is to say a continuous group homomorphism from G to 
the group of linear isomorphism of the complex vector space V such that 
the left action of G on V has no other invariant subspaces than V itself and 
{0}. We assume in addition that n is non trivial, i.e. is not identically equal 
to the identity. Such a representation does exist since G is assumed to be 
non trivial. 

Let A : I — > End(U) be a continuous map from I = [0, 1] to the complex 
vector space of linear maps from V to itself. For all (x, g) £ I x G, we set 

F(x,g) =Tr(A(x)n(g)), 

and let H(x,g) E C (I x G). Let us compute the correlation function 
Ctp(H, F)(n). Because ir is irreducible and non trivial, we have by Fubini's 
theorem 

/ Fdflp = Tv < A(x)dn 9 \ 7r(g)dm(g) > = 0. 
JlxG Ui Jg J 

Therefore we have 
C^H,F)(n) = [ H{T n x,r{T n - l x) . . .T{Tx)T{x)g)F{x,g)d^{x,g). 

J IxG 

For any / : I -> G, we set /M(a?) := f(x)f{Tx) . . . /(T^x). Using Left 
invariance of Haar measure we get 

C ip (H,F)(n) = [ H(T n x,g)F(x,(r- 1 p(x)g)dJl v (x,g). 

JlxG 

Using Fubini again and the action of the transfer operator L™, we obtain 

C v (H,F)(n) = 

f f H(x,g)h^x)- 1 ^{h^y)F(y,(T- 1 p(y)g)}(x)d^(x)drn(g). 
J G J I 

On the other hand we have 

Ll{K{y)F(y,{r- 1 t\y)g))(x) 

= TrL(g)h- 1 (x) £ e^ ) ^h v (y)A(y)n((r- 1 )^(y))[ , 

[ T"y=x J 

where (p( n '(x) = (f(x) + . . . + (p(T n ~ 1 x). It can be rewritten as 

{h v {y)F(y, Cr" 1 )^)} (x) = Tr {a{g)^{A){x)} , 

where M, : C°(/,End(U)) -> C°(/,End(U)) is the linear operator defined 
by 

M*(A)(x) :=h-\x) e^h^y)A(y)7T(r- 1 (y)). 

Ty=x 

To summarize the above computation, we have obtained 

(1) C v (H,F)(n) = [ i?(x, 5 )Tr{7r( 5 )M^(^)(x)}^(^,5)- 

JlxG 

^In this paper, all the representations are assumed to be complex. 
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Theorem 11.11 now follows from the next key result. 

Theorem 2.1. Under the assumptions of §1, for all e > 0, there exist 
infinitely many non equivalent irreducible finite dimensional complex repre- 
sentations ir a ,a £ S e 

ir a : G -> GL(V a ), 
such that each operator M 7ra has a real analytic eigenfunction A a ^ 

with the lower bound \X a \ > e ^ G ^ p ^- e \ 

This result shows the existence of non trivial point spectrum with a uni- 
form lower bound for an infinite family of transfer operators. In the simplest 
case of the one dimensional torus G = M/27rZ, irreducible representations 
(■7T q )q^z are one dimensional and given by the usual Fourier analysis i.e. 
ir q (9) = e~ iq0 so that the transfer operator M g is given by 

M q (A)(x) := h~\x) e^h^y)e^(y) A (y). 

Ty=x 

This is the usual "complex" transfer operator which plays a key role in 
Dolgopyat's approach [8] and subsequent works on hyperbolic flows [2D1 
[191 [HI [25] . A standard " diagonal approximation argument" in the spirit of 
quantum physics, see [10], tells us that the following conjecture should hold. 

Conjecture 2.2. For a generic choice of r, for all e > 0, there exists 
Qo > 1 such that for all \q\ > qo, the spectral radius p sp of "M q , when acting 
on smooth enough function spaces, satisfies 

In the one dimensional case 7(G) = 3/2, so up to a factor 3, our lower 
bound agrees with that conjecture. 

We now explain how to deduce the statement of Theorem 11.11 from the 
above result. Let us recall a basic fact about conjugate representations. If 
7r : G — > GL(T4-) is an irreducible representation on a finite dimensional 
complex vector space V n , there exists a Hermitian inner product on V n 
denoted by (., -) n such that ir is unitary. It induces a natural antilinear 
isomorphism 

where is the dual space. For simplicity, if v E we set T(v) = v. The 
dual space V w is now endowed with a hermitian inner product by setting 

{u,v)w ■= {v,u) T . 

The conjugate representation W : G — > GL(V') is defined by W = To 7r o T _1 . 
One can check that W is irreducible and that for all u, v £ V and jeGwe 
have 

(ir(g)u,v) n = (W(g)u,v) w . 
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Given A G GL(V n ) we can define A G GL(V^) by := Au, and the 
following formula holds 

(2) Tr(ir(g)A) = Ti(W(g)A). 

In terms of characters (the character is the trace of the representation), we 
have the formula 

x^(g) = xw(g) = xAa' 1 )- 

Fix e > and let S e be a (countable non finite) set of irreducible non 
equivalent representations as given by Theorem 12.11 By removing some 
elements of 

{ir a ,a G SJ, 

we can assume that for all a G § e , ir a is non trivial and either is equivalent 
to ir a , is not equivalent to any irp for all f3 G S e . Given A a (x) a real 
analytic eigenfunction of M^- a as given by Theorem 12.11 we set 

F a (x,g) = Re(Tr{ir a (g)A a (x)}), G a (x,g) = lm(Tr{Tr a (g)A a (x)}). 

Using Schur's classical orthogonality relations, we have 

f \Tr{ir a (g)A a (x)}\ 2 dji v = -j- / Tr{A a (x)A* a (x)}d^(x), 
JlxG "tt J I 

where d n is the dimension of the representation and A* is the adjoint op- 
erator for the inner product associated to rr. Recall that the equilibrium 
measure [i v has a Gibbs property and is thus positive on open sets, so the 
above integral is non vanishing. We can therefore assume (by replacing A a 
by iA a if necessary) that for all a, 

[ F^dfap > 0. 

i/xG 

We will need the following Lemma. 

Lemma 2.3. Let 7r a , tvr be two representations as above with a ^ {3, then 
we have 

/ FaFpdjl^ = \ FaGpdjl^ = 0. 
JlxG JlxG 

Proof. Write 

F a = ^(Tr{ir a (g)A a (x)} + Tr{7r a (g)A a {x)}), 

G a = ^(Tr{TT a (g)A a (x)} - Tr{TT a (g)A a (x)}), 

and use Schur orthogonality of non-equivalent representations together with 
formula ([2]) on conjugate representations. □ 

Let A e be the real vector space generated by the family of functions Fa 

A € = Span{F a , a G § a }. 
Pick F G C £ := A e \ {0} and write 

F = ^ a a F a , 
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where 3" is a non-empty finite subset of S a , and a a ^ for all a G 3". 
Computing the correlation function (F, F) (n) using formula ([T]) yields 

C v (F,F)(n)= a Q ^ / F a Re {\ n pTr(-irp(g)Ap{x))} dp v , 

a,p&? JlxG 

which using the orthogonality relations above turns out to be 
(3) 

C v (F,F)(n) = Y. a l (paCos(n6 a ) f F 2 a d^ - p>n(n0 a ) ! F a G a dft 



where we have set X a = p a e a , with p a > and # Q G R. We can now 
conclude the proof by using the Dirichlet box principle in the following 
form. 

Lemma 2.4. Let cti, . . . , ayv £R and D G N\ {0}. For a// Q > 2, one can 
/ind an integer q G {-D, . . . , DC}^} suc/i i/iai 

max dist(qa.i , Z) < — . 
l<j<iV J Q 

The proof is an elementary use of the box principle and we omit it. We 
can apply it to otj = 6 a /2-K to construct a sequence of integers n g such that 
n q — > +oo as q — > +oo with the property that for all q, for all a G 1, 

cos(n q 9 a ) > j and | sm(n q 9 a )\ J \F a G Q \d'jl (p < ^ J F^dji^. 

Going back to formula ([3|), we have the lower bound for all q 

C^(F,F)(n q )>e n ^ p ^^ J F 2 d^, 

which implies the statement of Theorem 11.11 

limsup|CV(F,F)(n)|™ > e 7(G)(P(2 V )-e)_ 



3. The simplest case of skew extensions by the torus 

Before we move on to the general case of extensions by a compact Lie 
group G, we would like to explain the basic ideas of the proof in the simplest 
case where G = M/2-7TZ. This section will serve as a guideline for the more 
difficult case of an abstract compact connected Lie group. 

3.1. Transfer operators on Bergmann spaces. We need first to be more 
precise about the choice of function space on which the transfer operators 
Mq act. For all j = l,...,k, we set Jj(x) = TJ (x) to be the inverse 
branches of T. Because T is real analytic and expanding, it is possible to 
show (see Bandtlow-Jenkinson [S]) that there exists e$ > such that for all 
e < £o, the complex domain 

rL := \z G C : min \z — x\ < e} 

xe[o,i] 
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is (strictly) contracted by each inverse branch jj . More precisely, for all j = 
1, . . . , k, jj extends holomorphically to f2 e and has a continuous extension 
to Q £ , in addition 

7j(sQ c n £ . 

By taking e small enough, we can assume that both cp and r have an holo- 
morphic extension to f2 e and a continuous extension to 0, £ . The classical 
Bergmann space B 2 (Q £ ) is defined as 

B 2 (fl £ ) : = j/ : O e -)■ C, / holomorphic and J \f\ 2 dxdy < +00 j . 

It is a Hilbert space when endowed with the norm 

|| 2 := j \f\ 2 dxdy. 

The transfer operators M. q : B 2 (Q £ ) — > B 2 (Q £ ) are defined by 

k 

M g (/)(,) = / l - 1 (z)^e^ z ) + ^ 2 )^( 7 ,z)/( 7 ^). 
j=l 

We remark that the above expression makes sense (provided that e is small 
enough) since it can be shown [T7] that the density h v which is given by 
Ruelle-Perron-Frobenius Theorem is actually non-vanishing and analytic on 
[0, 1]. Below we summarize the spectral properties of Mg that we use in the 
sequel. 

Proposition 3.1. Using the above notations we have: 

(1) Each M, q : B 2 (Q £ ) — > B 2 (Q £ ) is a compact trace class operator. 

(2) The spectral radius o/M g is bounded by 1 with respect to q. 

(3) Let |Ao(<z)| > |Ai((/)| > . . . > |A n (g)| denote the sequence of eigenval- 
ues ofM q . There exists a constant C > and < p < 1 such that 
for all q £ Z and all n G N, 

\\n(q)\ < Ce C ^p n . 

(4) For all q G 7L and all n G N, we have the formula for the trace o/M™ 

9 rhJ l-((T»)'(x))-i' 

where the sum runs over n-periodic points ofT andr^(x) = r(x) + 
t{Tx) + ... + r(T n - 1 x). 

Let us make some comments on the proof of this standard facts. Result 
(1) dates back to the work of Ruelle on expanding maps [22]. Bound (2) 
follows from classical contraction bounds and the formula for the topological 
pressure, see |17| . Proposition 2.1. Bound (3) follows [1], Theorem 5.13. 
Notice that the critical factor e c ^ comes from estimating 

sup \e iqT(z) \. 

These estimates, though they are trivial in the specific case of the torus, will 
require some special treatment in the full generality of compact Lie groups. 
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Formula (4) is a standard computation of the trace that can be found for 
example in [3]. 

3.2. A priori bounds on determinants. Just like in |17j . a priori bounds 
on dynamical determinants is a key step in the proof of Theorem 12.11 Since 
we want to prove the existence of non-trivial spectrum for the family M 9 , it 
is natural to define for (6 C 

Z q (() :=det(/-CM q ), 

which is an entire function of C and equals the infinite product 

Z q (C)=U(l-(Xn(q)). 

raeN 

We will need the following result. 

Proposition 3.2. Assume that for all \q\ large, Z q (() does not vanish on 
the open disc D(0,pi), for some p\ > 0. Then for all r < pi, one can find 
C r > such that for all \q\ large and all £ G D(0, r), 

K(0\ 



Zg(C) 

Proof. For all £ G C, we can write 



< C r \q\. 



N 



+ 1, 



|Z g (C)|<exp (^log(l + |C||A n (g)|)). 

\n=0 ) 

By splitting the above sum and using estimates (2) and (3) from Proposition 
13. H we get 

+oo N +oo 

^log(l + |C||A„(g)|) = ^log(l + |C||A„(g)|)+ M1 + IC||A„(<?)|) 

n=0 n=0 n=N+l 

n N+l 

<(iV + l)log(l + |C|) + C7^ |C|e c l"l. 

1-p 

Choosing 

" C\q\ ' 
log p\ 

we have for well chosen constants C\,C2 and large \q\ 

log |Zg(C)| < log(l + ICI) + C^ICI- 
Assume now that Z g (C) does not vanish on D(0,pi). Since Z q (0) = 1, we 
can define a complex holomorphic logarithm, denoted by \ogZ q (Q for all 
C G D(0,pi), with the property that log 2^(0) = and 

Re(IogZ,(C)) = Iog|Z,(C)|. 

We can now apply the Borel-Caratheodory estimate that can be found in 
Titchmarsh |26j. 

Lemma 3.3. Assume that f is holomorphic on a neighborhood of the closed 
disc D(0, R), and /(0) = 0. Then for all r < R, we have 
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Applying this lemma to /(C) = logZ> 9 (C)> we en d U P with the estimate for 
all |C| < r < r' < p lt 

the implied constant depending only on r, pi . □ 



^ 7^)2 (Clkl lo g(! + ICI) + C 2 |Cl) = 0(\q\), 



3.3. Proof in the easiest case. We can now prove Theorem 12.11 in the 
easiest case of the one dimensional torus. A first important observation is 
that for all |C| small enough (actually |£| < 1), using the formula for the 
trace, the determinant Z g (C) is given by 

/ \ 
(4) VC)=exp -^^Tr(M"^ 



1 n q ' 

n=l 



10 e v e " ( " )(x) 
* ^ 1 - (c^y^)- 1 



ex p E 



\ n=l T"x=x 

Given < r < 1, uniform convergence of the above series on the circle 
{\z\ = r} yields the integration formula 



[) XirJ^utf ^ l-((T*)'(x))-i- 

For simplicity, we set for all n > 1 and g£Z, 

We will use the following i/iefa inversion identity valid for all i > and 
all 6 £R, 

We point out that we have for all < c < vr 2 /4, as t — > 0, 



For all i > and n > 1, we set 

S(*,n) :=^e-^V(^9)l 



and we also define for all x G [0, 1] such that T n x = x, 



GJx) :-- 



i-«r»y(x))-i- 

The theta inversion formula yields 



T n x=x, T"y=y 



®It follows from Poisson summation formula and the identity for the Fourier transform 
of gaussians. 
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G n (x)G n (y)h(t,r^(x) -r^(y)), 

T n x=x, T n y=y 

each term in this sum being positive. Dropping all terms except the diagonal 
ones gives for all t small enough, and n large enough, 



s{t,n) - C ^SL x (i-((T-y(x)r^ 

V L T n x=x 

for some well chosen constants C\,Ci > 0. Keeping this lower bound for 
S(t, n) in mind, the end of the proof is by contradiction. Assume that for 
all \q\ > qo, qo being a large integer, the spectrum of JA q is included in an 
open disc D(0, p) of radius 1 > p > 0. This shows that the meromorphic 
function (\q\ > go) 

is actually analytic on a neighborhood of the closed disc -D(0,p -1 ). Fix 
e > 0. Using Proposition 13. 2\ we deduce using the integral formula © and 
contour deformation up to (p + e) -1 , that there exists a constant C e > 
such that for all |qr| > qr , 

\W(n,q)\<C e \q\(p + er-\ 

Therefore we have the upper bound 

S(t,n)< \W(n,q)\ 2 + C*(p + e) 2n - 2 £ |g|VA 
kl<go \q\>qo 

The integral formula ([5]) is valid for all radii r < 1 so using proposition 13.21 
again we get that 

£ \W(n,q)\ 2 = 0((l+e) 2n - 2 ). 
\g\<io 

On the other hand, we have using summation by parts, 

r+oo 

V q 2 e- q2t = 2 / [u]u(u 2 t - \)e~ uH du. 
<?>0 Jl 

A change of variable v = u\/i in the integral yields as t — > 0, 

q>0 V 7 

In a nutshell, we have for n large and t small, 

(6) C 2 Y eV " >(x) <0{Vt{l + e) 2n ) + 0{t-\p + e) 2n ), 

T n x=x 

where the implied constants do not depend on t, n. We recall that a classical 
formula on the topological pressure states that 

lim ( Y ' =e p ^\ 

\T n x=x / 



n— >+oo 
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Now set t = p 2n for some < p < 1. Going back to ([6]) and using the above 
formula on the pressure we get letting n — > +oo, 

e p ^ <max|/x(l + e) 2 , 

a contradiction whenever 

p < e p ^(l + e)- 2 and p + e < pe\ P{2 ^ . 

Since e is arbitrarily small, we can clearly get a contradiction for all p < 
e5 p ( 2 ^), and the proof is done with 7(G) = 3/2. □ 

The wise reader will have noticed that h(t, 9) is the heat kernel on the torus. 
This will play an important role in the proof of the general case. 

4. LAPLACIAN AND A PRIORI BOUNDS ON REPRESENTATIONS 

In this section we prove the necessary upper bounds that are required to 
mimic the elementary proof of the previous section. A basic knowledge of Lie 
Group theory is required, our main references are [U [12] . In the following 
of this paper, we assume that G is a compact connected Lie Group. We 
wil denote by ec the neutral element of G. The (real) dimension of G is 
denoted by d. A Lie Group has always a real analytic structure for which 
G is a real analytic manifold. Left and right translations, inversion are real 
analytic diffeomorphism on G. Any linear representation it : G — > GL(V) 
is automatically real analytic. Let g be the Lie algebra of G. Since G is 
compact, there exists an euclidean inner product (5 on g wich is invariant by 
the adjoint representation Ad i.e. for all X, Y G g, for all g € G, 

f3(Ad(g)X,Ad(g)Y) = (3(X,Y). 

This euclidean inner product on g ~ T ea G then induces a natural left-right 
invariant Riemannian metric (see [6] p. 102) (3 on G which is also real an- 
alytic. Clearly the Riemannian volume inherited from the metric /3 is also 
invariant by (left-right) translations and is proportional to Haar measure m 
so we assume for simplicity that they are equal. Let A denote the (positive) 
Laplace Beltrami operator associated to /3. Let X%, . . . ,Xd be an orthonor- 
mal basis of g for /3, then the Laplacian A acts on C°°(G) by 

d 

A/ = -^Af(/), 

i=\ 

where A", are understood as left-invariant vector fields on G. Let 

7r : G — t- GL(K) 

be an irreducible complex representation of G. Let / be a coefficient of the 
representation tt, i.e. for all x G G, 

f(x) = Tr(A7r(x)), 

where A G End(V r 7r ). It is a classical fact (see [12], p. 163) that / is an 
eigenfunction of A: 

A/ = K^f, 




14 



FREDERIC NAUD 



where K n > depends only on n. All the estimates will be established with 
respect to the spectral parameter k w . Notice that since the eigenspaces of 
the Laplace operator are finite dimensional, there are only finitely many 
non-equivalent irreducible representations that share the same eigenvalue 

Let us now use Sogge's classical bound (see [21], Proposition 2.1) on L°° 
norms of eigenfunctions: 

\\f\\oo<c K ^\\f\\ LHG) , 

where C depends only on G and the choice of /3. In the particular case 
when f(x) = Xir( x ) = Tr(7r(x)) is the character of the representation, we 
get (characters of irreducible representation have a normalized L 2 norm) 

(7) dim(vr) = X7r (e G ) < C^" 1 )/ 4 . 

Thought this dimension estimate is clearly not optimal on the cf-torus, it is 
optimal for example on G = SU2(C). This upper bound will be useful in the 
rest of the paper, however optimality of the exponent is not important for 
us (any polynomial bound would be enough). Remark that in the examples, 
one can derive such a bound from the Weyl character formula. On the 
complex vector space V n , there exists a hermitian inner product such that 
the representation ir(x) is unitary. We fix this hermitian structure on each 
V n and denote by ||.|| the associated norm on V n . Define the following norms 
on End{V n ). 

\\A\\ HS := (Tx(A* A)) 1 / 2 ; \\A\\ := sup \\Av\\\ 

\\v\\<l 

The adjoint A* is understood with respect to the above unitarizing inner 
product. These two norms are related by the classical inequalities 

Mil < \\A\\hs < vMim(7r)M||. 

Let us go back to the notations of §3. We recall that f2 is a complex neighbor- 
hood of [0, 1] . The compact extension of T is defined through a skew function 
r : [0, 1] — > G which is assumed to be real analytic. Since any irreducible 
representation n is real analytic, by taking f2 small enough, z i— > 7t(t(z)) has 
a holomorphic extension to f2 which is continuous on f2 and takes values in 
End(X^-). A priori 0, f2 depends on ir. However we will prove the following. 

Proposition 4.1. There exists a small enough neighborhood £1 of [0, 1] such 
that for all irreducible complex representation ir of G, z \— > it(t(z)) has a 
holomorphic extension to £1 which is continuous on and enjoys the bound 

su P |K(t(z))|| < C(^) 3(d - 1)/8 e c ^, 
for some uniform C > 0. 



It follows from the existence of an analytic complexification G C Gc, see [B], chapter 
27, that every finite dimensional representation can be holomorphically extended to the 
complex analytic group Gc, which shows that Q can actually be chosen uniform with 
respect to it. However in the sequel, we need an effective estimate and won't use the 
existence of Gc- 
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Proof. Fix g G G and Let g G U C G be a small coordinate neighborhood 
which we identify with an open euclidean ball 

S(0,po) C M d C C d . 

Assume that the real analytic Riemannian metric (5 has a convergent power 
series expansion on this ball. Denote by A the associated Laplace operator. 
Then it follows from the analysis of Donnelly-Fefferman [TT] that one can 
find < p\ < po such that for each eigenfunction F : B(0,po) — > C solution 
of the elliptic equation 

AF = XF 

has a holomorphic extension to the (complex ball) Bc(Q, p\) C C d together 
with the bound 

sup \F(z)\ < e c ^ sup \F(x)\. 

z£B c (0, Pl ) x£B(0,p ) 

Each coefficient of the representation being an eigenfunction of the Lapla- 
cian, it is now clear that by compactness of [0, 1] and real analyticity of r, 
one can choose a small enough Q which is uniform with respect to repre- 
sentations. To prove the desired upper bound on ||7t(t(z))||, it is enough to 
work locally. Choose xq G [0, 1], set go := t(xq) G IX, where (It, 99) is a local 
chart as above with cp : U — > -6(0, po) and (f(go) = 0. The map x — > ip(r(x)) 
is real analytic on a neighborhood of xq. Choose e > so small that for all 
z G Bc(xo,e), (p(t(z)) is in #c(0, pi)- Let Eij, with 1 < i,j < dim(7r) be 
an orthonormal basis of End(V^-) for the inner product (A,B) 1— > Ti(A*B). 
Each matrix coefficient g 1— > Ti(EijTr(g)) is an eigenfunction of A so we have 
for all z G Bc(xo,e), 

|Tr(^7r(r(z)))| < e C v^ sup |Tr(^-7r( ff ))| 

< e Cv ^sup ||7t(5)||hs = e c v /7 ^ v / c iim(7r) 
a 

by Schwarz inequality and the fact that ir is unitary. Writing 

Mr(z))\\ 2 HS = Y,\ME l M^)))\ 2 < dim(vr) 3 e^, 

y 

the proof is done using the estimate (J7|) . □ 

5. Dynamical Zeta functions and Trace formula 
Recall that our goal is to study the point spectrum of the transfer operator 
M*(/)(aO :=h-\x) ^ iv) h v (y)f(y)n(T(y)), 

Ty=x 

where is a real analytic density fusnished by the Ruelle-Perron-Frobenius 
Theorem. We need to define a natural "matrix valued" function space which 
in our case will be 

:= |/ : n -^End(V n ), holomorphic and J \\ff HS dxdy < +oo| . 
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It is a Hilbert space when endowed with the norm 

| 2 := / WfWhdxdy. 
Jn 



In the sequel, we assume that $7 is a small, fixed complex neighborhood of 
[0, 1] such that all the previous analysis holds true. We recall the notations 
of §3. The contracting inverse branches are denoted by 7j : 0, — > fi and 
we have for all j = 1, . . . , k, C fi. Given z G f2, M"(/)(z) can be 

expressed as follows 

M n M)(z) = h~ 1 (z) £ K{ la z)e^ n) ^f{ la z)^ n \ la z)l 

\a\=n 

where a 6 {1, . . . , k} n and 7 a := j ai o . . . o 7 an . We have the following facts. 

Proposition 5.1. (1) Each M n : B%(Q) ->• B^(fi) is a compact trace 
class operator. 
(2) The spectral radius of is bounded by 1. 

Xei |Ao(vr)| > | Ai (tt) | > ... > |A„(7r)| denote the sequence of eigen- 
values ofM n . There exists a constant C > and < p < 1 suc/t 
i/tai /or a// 7r complex irreducible and all n G N, 

|A„(tt)| < Cfa^e^p". 

(^j For a// 7r complex irreducible and all n £ N, we have the formula for 
the trace o/M™ 

Tr(M«) = dinn>)J£ _ 

where x-w{g) is the character of it. The sum runs over n-periodic 
points of T and (x) = r(x) . . . r(T n - 1 a;) . 

Proof. (1) We let the reader check that is indeed bounded and compact 
by following the same ideas as in the scalar case. The fact that it is trace 
class will follow from the summability of the singular values estimates. 
(2) It is enough to estimate the spectral radius when acting on contin- 
uous functions C°(I, End(V^)). Indeed, any B^iyi) eigenvalue is also a 
C°(7,End(K)) eigenvalue. We endow the space C°(I, End(K)) with the 
obvious norm 

||/|| :=sup||/(x)||. 

xei 

Let / G C°(I, End(y 7r )) and write (using unitarity of it) 

\\M n M)(x)\\ <h~\x) £ h v { la x)e^ n) ^\\f{ la x)l 

< C I ^P-e/V^CTax) i ||7||() _ 

\|a|=n 

Now the claim follows readily from the formula of the topological pressure: 
lim [ Y ' =e p ^ = l, 

n^+oo \ I 



\T n x=x 
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and the fact that there exists M > such that for all n and all x G I, all 
<*£{!,. ..,*}», 



< M 



which is a standard fact in uniformly hyperbolic dynamics referred as "bounded 
distortion property" . 

(3) This estimate will follow from a singular value estimate. We recall that 
the n-th singular value of the compact operator is by definition the 
n-th eigenvalue (ordered decreasingly) of the positive compact self-adjoint 
operator ^M* M^. They are given by Courant's minimax formula 

s n (M n ) = min max ||M 7r (f)||32. 

dim(F)=n/eFM|/||<l 

In particular, we can derive the fact that for any basis (ez); e pj of B 2 (Q), 

s n (M*) <£||M*(e,)||ija. 

l>n 

To be able to use that estimate, we need an "explicit" basis of B 2 (£l). We 
point out that if O is of type £l t := J + 5(0, e) then the boundary is actually 
"Dini-smooth" (see [2T]) and there exists a conformal mapping tp : Q — )■ D, 
where B is the unit disc such that both ip and ip' are continuous up to the 
boundary of Vt. There is thus an isometry 

B 2 (B) -> B 2 (Q) 

f -> W°V0- 

Viewing our Hilbert space B 2 (£l) as 

Bl(Q) = B\n), 

l<«,J<dim(7r) 

we have a natural Hilbert basis given by the family (I E N, 1 < i,j < dim(7r)) 



3 : 



Where is the linear map of V n into itself whose matrix in a fixed or- 
thonormal basis of has zero entries everywhere except 1 for row i and 
column j. 

For all z G 0, we write 



\M*(e?)(z)\\HS 



, d-l 



< Cifcsupe^ydlnr V 77)(^) 3 ^e c v / ^ m ax ||ef ( 7m z)|| M , 
But we have 

2 



K J (7m«)||jf,Sf 

and therefore 



' + „ j 



7T 



V ; '(7m^)(V ; (7m^)) 



K y (w)ll^<c 2 iV, 

where 

p = sup \ip(j m z)\ < 1. 

zeO, l<m<fc 
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To conclude this estimate, we have 

Sn(M 7r )<^^||ef( 7ro2 )|| B2 

l>n i,j 

< C Z K d - l e c ^(p) n , 
where p < p < 1. To relate it with the eigenvalue estimate, we simply write 

/ n \ V™ / n \ V" 

|A re | < ( ni Afe l) ^ (II Nj ' 

where we have used (in the second equality) a standard Weyl inequality (see 
[23] on Weyl inequalities) which gives the desired estimate. 
(4) The trace is usually defined by the following formula: 

Tr(M«) :=££<ef,M«(ef)) B2 . 

1=0 i,j 

Let us write 

£<ef ,M£(ef = 



ttij-aOO := Tr (s*.^-7r(rH( 7a2 ))) . 



\a\=n i,j 

where we have set 



Since we have 
we have 



EijEij — Ejj, 



E^oW = dim(7r)Tr(vr(rH( 7aZ ))). 

We end up with 

i,3 

dim(Tr) I ^- 1 (^)^( 7a2 )e^ ( " ) ^^iKi)eK7a^)x 7 r(T [n] (7a^))^dy. 
ii i/ ^ 

|o|=n 

Summing over all i, using uniform convergence and Fubini, we are left to 
compute 

Tr(M™)= V [ F n (z)B n ( 7a z,z)dxdy, 

\a\=n 

where F n (z) = diui(7r)h-\z)h^ a z)e^ n) ^ X Ar [n] (l a z)), and B n (z,() is 
the classical Bergman kernel of the domain f2. Using the conformal change 
of variable, we can assume that f2 is the unit disc and it is now a standard 
computation (using Stokes theorem) that yields the desired formula. □ 

We can now state the analog of Proposition 13.21 We set in the following 
for all C € C, 

2^(0 :=det(/-CMJ. 
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Proposition 5.2. Assume that for all K n large, Z> n (C) does not vanish on 
the open disc D(0,pi), for some p\ > 0. Then for all r < p\, one can find 
C r > such that for all K n large and all £ G D(0,r), 



24(0 



< a 



Proof. Use the bound (2) and (3) from the previous proposition and mimic 
the proof of Proposition 13. 21 One can observe that the polynomial terms in 
estimate (3) do not contribute to the final estimate. □ 



6. Heat kernels on Compact Lie groups 

Our basic reference for that section is [JJ. Let M be a compact d- 
dimensional Riemannian Manifold, let A be the (positive) Laplacian on 
M. Let / G L 2 (M) and consider the Cauchy problem (heat equation): 

,o\ ( Au(x,t) + d t u(x,t) = 0, t > 

[ ' \ Mm t ^Qu{x,t) = f{x) G L 2 . 

It is a well known fact, see [7J, chapter 5, that there exists a unique kernel 
H(t; x, y) G C°°((0, +oo) x M x M) such that for t > 0, 

u(t,x) = f H(t;x,y)f(y)dVo\(y), 

J M 

solves the problem ([8]). Moreover H(t;x,y) > for all t > 0. A basic lower 
bound which will be useful for us is following. One can find a constant C > 
such that for all t > small enough and x, y G M, 

(J dist^.i;) 2 

where dist(x,y) is the Riemannian distance. This estimate follows from a 
Harnack estimate of Li and Yau (see [7J, P. 162) and the local asymptotics 
on the diagonal as t — > 0. This estimate is actually valid on non compact 
complete manifolds with Ricci curvature bounded from below. If we assume 
that M = G has a Lie group structure then a formula for the heat kernel 
H (t; x, y) can be derived using characters of representations. More precisely, 
we have the following. 

Proposition 6.1. Assume that G is a compact Lie Group endowed with a 
left-right invariant Riemannian metric. Then for all t > 0, we have 

H(t;x,y) = htixy- 1 ) := ^ e-*^dim(vr)^(xy" 1 ), 

7T 

the sum (on all irreducible representations) being uniformly convergent. 

Proof. This result is fairly standard (see [12], chapter 12), however we will 
encounter in the proof some estimates that will be important later. First 
we recall that by Weyl asymptotics, as R — > +oo, 



#{A G Spec(A) : A < R} ~ C d R d/2 , 
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eigenvales being counted with multiplicities. Since the space M n of coef- 
ficients of the representation it has dimension dim(7r) 2 and each F E M v 
satisfies AF = K n F, we deduce that 

N(R) := dim(vr) 2 < CR d/2 . 

Let / E L 2 (G) and set for all t > 0, 

u (x,t) := ^e-^'dim(vr)TV(/(7r)7r(x)), 

where 



/(vr) = / f{g)K{g- l )dm{g). 



/G 

By Peter- Weyl theorem (see for example |12j . Chapter 6), this above ex- 
pression makes sense in L 2 (G) and is equal to / for t = 0. Let us show 
that u(x, t) indeed solves the heat equation. First remark that by Schwarz 
inequality (twice), we have 

|TV(/(vr)7r(x))| < \\f^)\\ HS h(x)\\ HS < dim(7r)||/|| L2(G) . 

This allows us to bound using Stieltjes integrals (t > 0) 

r+oo 

W(x,t)\ < ^e-^dim(7r) 2 ||/|| L2 = ||/|| L2 / e- vt dN{v). 

Using summation by parts, the above integral is clearly seen to be convergent 
since N(v) = 0(v d / 2 ). Therefore the above series are uniformly convergent 
for all t > 0. Similarly, we have 

|A(Tr(/(7r)vr(x)))| < ^dim(7r)||/|| L2(G) , 

so that 

^V K ^dim(7r)A (Tr(/(7r)vr(x)) N 

is uniformly convergent, allowing us to write 

Au(x,t) = ^e" K7r *dim(7r)K 7r Tr(/(7r)vr(x)). 

On the other hand, a similar argument shows that 

d t u(x,t) = -^e- K ^dim(7r)^Tr(/(vr)vr(x)). 

It remains to check that lim^o u(x, t) = f(x) in L 2 (G) sense. This follows 
easily from Plancherel formula 



\\u(x,t) - f(x)\\ 2 L2 = ^dim(7r)||/(7r)(l - e—*)!^ 

= (l-e-^) 2 \\f\\h- 
Using uniform convergence, we can finally write (t > 0) 

u(x,t) = £ e -«**dim(7r)Tr /(^(^dm^Mx)) 
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= Ve K ^dim(7r) / f(g)xn(g 1 x)dm(g) 
_ Jg 

h t {xg~ 1 )f{g)dm(g). 



>G 

Uniqueness of the heat kernel concludes the proof. □ 
7. Proof in the abstract case 
The proof starts with the integral formula (r > 1) 

1 r 2' (r) P ^ n H x ) 

(9) / P^C n d( = dim(vr) V Xn(T [n] (x)) — , . = . 

We set for all tt irreducible and n > 1 

The first step is to examine the following average on representations: (t > 0) 



&(n,t).-2^e d . m(7r)2 



2 



Proposition 7.1. There exists a constant A > suc/i £/iaf /or all t > 
sma/Z and n > 1, 

S(n,t)>^-^ Y, eV " )W > 

where rank(G) is the real dimension of maximal torii. 
Proof. By a direct computation, we have 

§(n,t)= Y " w . , = r- ttt r F(t;rM(a:),rW(x / )), 

T n x l =x l 

where we have set 

F(t;a,b) :=^e- te "x,(fl)P). 

Using the formula 



L 



XAxgyg )dm(g) - 



Ig dim(7r) 
and uniform convergence of the above series for t > 0, we get 



F(t;a,b)= / /^(afl* *s ^dm^), 



where /it 0*0 is the heat kernel, see previous §. The heat kernel being positive, 
we drop all the off-diagonal terms to get 

2^(") (x) 

S(M) - T ? (i-((r"y ( x))-i)^ (t;rW(x) ' rW(x)) - 

We therefore need to estimate from below the quantity F(t; a, a) for all 
a € G. First observe that if G is commutative i.e. is a o!-torus, then 
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F(t,a,a) is just /it(ec) where ec is the neutral element, and the claim 
follows readily using the short time asymptotics of the heat kernel. If G 
is not a torus, then we can still use Cartan's theorem (see [6]) which says 
the following things. Call a maximal torus a maximal (for the dimension) 
abelian subgroup of G. 

(1) All maximal torii are conjugated. 

(2) Every g € G is inside a maximal torus. 

Given a maximal torus T C G we detone by T e the e-tube around T defined 
by 

T e :={<?£G : dist( 5 , T) < e}, 

where "dist" is the left-right invariant Riemannian distance. Notice that by 
property (1) of Cartan's theorem and invariance of both distance and Haar 
volume, for all maximal torii T, T', we have for all e > 

m(T e ) = m(T'J, 

where m is Haar measure. Given a £ G, pick a maximal torus T 3 a and 
write 

F(t;a,a) > / h t {agaT l g~ 1 )dm(g). 

Using the Gaussian lower bound for the heat kernel from §6, we have there- 
fore 

C f ( dist 2 (aga^ 1 g^ 1 ,ea) 



F(t;a,a) > ^ exp ^ — - J dm{g). 

Given g £ T e , pick g £ T such that dist (g, If) < 2e. We have 
dist(aga~ 1 g~ x , ec) = dist(ag, ga) 
< dist(a<7, ag) + dist(ap, ga) +dist(pa, ga) 
=o 

= 2dist( 5 ,s0 <4e. 
Taking e = y/t, we get for all t > small, 

(10) F(t;o,o)>^-m(T e ). 

Remark now that m(T e ) does not depend on the chosen maximal torus (and 
hence a) and we can fix a maximal torus T once for all to compute m(T e ). 
Since Haar mesure is proportional to Riemannian volume and maximal torii 
are smooth submanifolds, the final estimate will follow from an easy volume 
estimate (from below). Set for simplicity r = rank(G). By B n (0, a) we mean 
the euclidean ball of K n of radius a centered at 0. The usual euclidean norm 
on R™ is denoted by \x\. Let 11 be a coordinate neighborhood around ec 
and tp : U — > M. d a coordinate map such that 

^(lt)=B r (0,oi) x B d _ r (0,a 2 ). 

Since T is a submanifold, we can linearize it locally and choose tp so that 

^(THU) = B r (0,ai) x {0}. 

Without loss of generality, we can assume that the Riemannian metric g = 
^2 gijdx l dx J in this coordinate patch is continuous up to the boundary. Let 
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d g (x,y) denote the associated distance on ip(U). Compactness then shows 
that for all x,y G ip(U), 

d g (x,y) < Ci\x - y\, 
for some C\ > 0. For all e > small enough, we have 

V>(T e n It) D B r (0, ai) x £ d _ r (0, e/Ci). 

Therefore, 

m(T £ ) > m(T e n It) = / J det(gij)dx! ...dx d 

> C 2 Leb(5 r (0,ai) x 5 d _ r (0, e/Ci)) = CV^, 
here Leb is of course Lebesgue measure. Going back to formula (|10p and 
writing e = the proof is done. □ 

We can now go back to the main proof of Theorem 12.11 Fix R > large 
and assume that for all irreducible tt with > R, the compact operator 
: B%(Q) — > B%(Q) has no eigenvalues outside the disc 

{z G C : \z\ < p < 1}. 

Each meromorphic function £ i— > 24 (£)/£.„-(£) is therefore analytic inside 

{C G C : |C| < p- 1 }. 

Using the integral formula ([9]), we can perform a contour shift and use the 
upper bound of Proposition (|5.2p to deduce that for K n > R, we have for all 
e > 0, 

\W(n,w)\ < C^p + e)"- 1 ^. 

On the other hand, for all tt with k v < R (which corresponds to a finite 
number of non-equivalent irreducible representations), we can use the trace 
formula and the fact that P((p) = to write for all e > 0, 

\W(n,q)\<C e (l + e) n . 

Gathering our estimates, we have for all e > 0, all t > small and n > 1, 

At -rank(G)/2 £ e V">(*) < ( (1 + e )2n) 



V ^ (dim(vr))^ 



Assume we have established that as t — )■ 0, 

^ (dim(vr)) 2 V 

for some (3 > 0. Choosing t = e~ an we get 

/ \ V" 



e «rank(G)/2 [ (x) 



\T n x=x 



< ( 0((1 + e) 2n ) + 0(e a/3n (p + e) 2n )' X ' " 



21 



FREDERIC NAUD 



Taking the limit as n — > +00, we have 

e arank(G)/2 e P(2^) < max{(1 + ^ (p + ^afiy 

We have a contradiction if we take 

2|P(2^)| 



a 



rank(G) 



3e, 



and 



-a/3/2 



(I _|_ Ag~ de P/ J g P rank(G) i 



p + e < (1 + e)e" 

We can therefore take for 7(G) = /3/rank(G). It remains to compute f3 in 
general. The quality of the estimate highly depends on the informations 
that we have on dim(7r). Clearly if we have no available lower bound for 
dim(7r), we can write 

4- (dim(vr))2-^ 



< 



+00 



-tu 



udN(u), 



where N(u) is the counting function for the eigenvalues defined in §6. Sum- 
mation by parts yields 



+00 



-tu 



udN(u) = O(l) + 



+00 



-tu 



(tu - l)N(u)du 



f+00 
()[t J e 



This leads to the value 7(G) 
the most classical groups. 



tu u d ' 2+1 duj = O (t-( 1+d ^) . 
l+d l 2 Below we list the values of 7(G) for 



ak(G) • 



Group G 


Constant 7(G) 


T d = R d /27rZ d 


-+- 

2 T d 


U n (C) 


n 1 1 
2'n 


SU 2p (C) 




SU 2p+1 (C) 


±+2p+2 


S0 2p (R) 


1 , 2p-l 
p+ 2 


S0 2p+1 (R) 


1 , 2p+l 
P + 2 



We point out that except in the case of torii where dim(-7r) = 1, the values 
of 7(G) can be improved when some explicit enough formulas are valid, 
which should be the case of some of the groups listed above. Let us just 
have a look at the example of SU 2 (C). In that case the irreducible complex 
representations 7r m are parametrized by m 6 N and we have K- Km = m(m+2), 
dim(7r m ) = m+ 1, see for example [12]. Going back to the above estimate, 
we are left with 



(dim(7r)) 2 




-tm(m+2) 



= o (t- 1 ' 2 ) 
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We have obtained j(SU2(C)) = 1/2 instead of the 5/2 given by the above 
formula. Being doubly covered by SU2(C), the same estimate holds for 
S0 3 (R). 
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